On Some Optimal Stopping Problems with Constraint
نویسندگان
چکیده
We consider the optimal stopping problem of a Markov process {xt : t ≥ 0} when the controller is allowed to stop only at the arrival times of a signal, that is, at a sequence of instants {τn : n ≥ 1} independent of {xt : t ≥ 0}. We solve in detail this problem for general Markov– Feller processes with compact state space when the interarrival times of the signal are independent identically distributed random variables. In addition, we discuss several extensions to other signals and to other cases of state spaces. These results generalize the works of several authors where {xt : t ≥ 0} was a diffusion process and where the signal arrives at the jump times of a Poisson process.
منابع مشابه
On Some Impulse Control Problems with Constraint
The impulse control of a Markov–Feller process is considered when the impulses are allowed only when a signal arrives. This is referred to as an impulse control problem with constraint. A detailed setting is described, a characterization of the optimal cost is obtained using previous results of the authors on optimal stopping problems with constraint, and an optimal impulse control is identified.
متن کاملOn approximative solutions of optimal stopping problems
In this paper some extensions are given of the method to approximate optimal discrete time stopping problems by related limiting stopping problems for Poisson type processes. In particular we establish detailed results for the solutions of the differential equations characterizing the optimal stopping curves in the limiting stopping problem. These allow to determine explicit approximative optim...
متن کاملA Hierarchical Cognitive Threshold Model of Human Decision Making on Different Length Optimal Stopping Problems
In optimal stopping problems, people are asked to choose the maximum out of a sequence of values, under the constraint that a number can only be chosen when it is presented. We present a series of threshold models of human decision making on optimal stopping problems, including a new hierarchical model that assumes individual differences in threshold setting are controlled by deviations or bias...
متن کاملA Note on Optimal Stopping in Models with Delay
It is known that optimal stopping problems form an important class of optimal control problems having applications in stochastic calculus (maximal inequalities), statistics (sequential analysis) and mathematical finance (American options). The results about the relationship between optimal stopping problems for Markov processes and free-boundary problems for partial differential equations often...
متن کاملVARIATIONAL DISCRETIZATION AND MIXED METHODS FOR SEMILINEAR PARABOLIC OPTIMAL CONTROL PROBLEMS WITH INTEGRAL CONSTRAINT
The aim of this work is to investigate the variational discretization and mixed finite element methods for optimal control problem governed by semi linear parabolic equations with integral constraint. The state and co-state are approximated by the lowest order Raviart-Thomas mixed finite element spaces and the control is not discreted. Optimal error estimates in L2 are established for the state...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- SIAM J. Control and Optimization
دوره 54 شماره
صفحات -
تاریخ انتشار 2016